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ABSTRACT 

We  give  an  example  of  a  curved  exponential  where  the  maximum 
likelihood  estimate  is  not  third  order  efficient  either  in  the 
sense  of  Fisher-Rao  or  Rao. 
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1.  INTRODUCTION 


That  the  maximum  likelihood  estimate  (m.l.e.)  is  second  order 

efficient  has  been  proved  under  various  conditions  by  Ghosh  and 

Subramanyam  (1974),  Efron  (1975),  Ghosh,  Sinha  and  Subramanyam 

(1979),  Ghosh.  Sinha  and  Wieand  (1980),  Pfanzagl  and  Wefelmeyer 

(1976,  1979)  and  Takechi  and  Akahira  (1978).  In  the  last  three 

references  this  property  is  referred  to  as  third  order  efficiency; 

this  use  of  the  term  should  not  be  confused  with  ours,  which  will 

be  formally  introduced  in  the  next  section.  The  purpose  of  this 

note  is  to  produce  an  example  of  what  Efron  (1975)  calls  curved 

exponentials  where  the  efficiency  of  the  mle  fails  in  the  class 

of  Fisher  consistent  estimates  when  we  take  into  consideration 

-3 

third  order  terms,  (namely  terms  of  0(n  ))  ,  in  the  expression 

for  the  mean  square  of  the  error  of  estimates  concerned  or  terms 
of  order  0(n~'*')  in  the  expression  for  the  loss  of  information}, 
vide  (3.1)  and  (4.1).  On  the  whole  we  have  conformed  to  the 
notations  and  conventions  of  Ghosh  and  Subramanyam  (1974)  and 
our  definition  of  third  order  efficiency  is  in  analogy  with  that 
of  second  order  efficiency  presented  there,  but  this  note  can  be 
read  independently  of  it.  All  our  computations  are  a  straight¬ 
forward  application  of  the  so  called  delta  method  and  may  be 
justified  as  in  Ghosh  and  Subramanyam  (1974)  or  Ghosh,  Sinha  and 
Subramanyam  (1979);  no  further  reference  will  be  made  to  this 
aspect . 

In  Section  2  the  counterexample  is  introduced  and  the  mle 
expanded.  Lack  of  third  order  efficiency  is  established  in  Sec¬ 
tions  3  and  4. 
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2.  THE  COUNTEREXAMPLE 


Consider  a  one-parameter  trivariate  density 


2,2  x3 


fe(x1,x2,x3)  =  exp{-  £  (x1-0 )  -  i(x2-e  )  -  -Tj-} 


l  > 

!  i 


{ Ax2  Xg  +  Bx2  +  2C  x1x2x3} 


(2.1) 


(A(i+e2)  ( i+e4)+  b}~a {2tt} 


~1 : o_ ;_3/2 


-  °°  <x^  <  °°,  i  =  1 ,2 ,3 

—  OO  <  0  <  CO 

A  >  0  ,  B  >  0 ,  AB>C2 


with  A,B,C  independent  of  8. 

Let  ,X3i}  be  n  i.i.d  copies  of  X^,X2,X3>  Then  the 

likelihood  L(0)  is  the  product  of  n  terms  exemplified  by  (2.1). 
Hence  the  derivatives  of  log  likelihood  are 

-  (Ve>*2e(x2-e2> - 

n  n  a  B  i  *  (A+B)+A6  +A0  +A6b 

W*  .  I  ,  .!  +  2(X  -e2)  -  492  - A(2tl2|243084) 

n  n  d02  2  (A+B)+A02+A04+A06 

+  A2( 26+463+685)2 

{ ( A+B)+A( 02+04+06 ) }2 

*  _  1  d3  log  L  -_12e  A( 249+12093)  +  A2(2+1292+3O04)(28+483+685) 

n  n  d©3  ( A+B)+A( 02+04+06)  (A+B)+A(02+04+06) }2  ~~ 

2A2(29+403+685)(2+1202+3O94)  _  2A3( 20+403+605)3 

-  '2  '  '4  _  „6  ,  -i  2  r  ,  A*n  \  .  <i  /  a  2  ,  ~  4  r6,  -.3 


{  (  A+B)+A(  0  +0  +0  )  }4 


.  (  A+B)->'-A(  0  +0  +5  )  } 


U  *  i  I  d  log  L 
n  n  d6 


n(9),  say. 
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Clearly 


1(0)  =  E  (-  | 

0  n  de2 


-  2  E „(L-«2]  *  482  ,-M-2^28^3064) 
z  (A+Bj+AO^+e^+e®) 

<?  *3  S  9 

A  (284-46  +66  ) 
{(A+B)+A(62+64+06)}2 


To  compute  1(6)  we  need 

E  (X  -e2)  =  - ?-a-9-2(.i+A.  ..  . 

H  *  (A+B)+A(6  +6  +6°  ) 

Let  W  =  W*  +  1(6)  so  that  Ea  W  =0. 
n  n  8  n 

We  shall  now  get  an  expansion  of  the  mle  9.  Clearly 
0  =  Zn  +  (8  -  6)(W  -1(6))  +  4(6  -  6 )2  V*  +i(8  -  0)3U*  +  smaller  terms. 


So  writing, 


A  A,  A  ty  Art 

8  -  0  =  — i  +  —  + 

✓n  n  n3/2 


and  substituting  in  the  previous  equation  we  get 


Z - i  1(0)  *  0 

n  /n 


A  A 

—  W  ~  1(6)  +  4  V  =  0 

/5  n  n  n  n 


(2.2) 


n  Wn  *  ^372  I(9) 


A  A  A 

+  —  •  vn  +k—>  u  =  0 

/n  n  n  6  SZ  n 


From  these  we  determine  A^.Ag.Ag  and  substitute  in  (2.2)  yielding 


Z  W 


2  * 
TT  V 


Z  W  Z2  V* 


n  j.rn  n^!  n  n^  .  r;  n  n  ^  n  nu  n 

ftT  +  (-5 -  +  «  —* - 1  +  C  {-5 -  +  — O - )  if  /ft'  V  +  “ 

tt)  1^(6)  l  ($)  I2(6)  IJ( 6 )  I(  3  I“(6) 


Z  V* 
n  n 


,  1  Un  <  , 
6  I4(9) 


(2.3) 
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Z  W  Z2  V* 

0,(8)  =  £  +  i  -2— £ 

*  1(0  >  I  (9) 

Z  \¥  Z2  V*  W  Z  V*  U*  Z3 

Q3(6)  -  i  +  -|-a)  +  § 

3  I2(0)  I3(0)  I(0)  I2(0)  6  I4(0) 


(2.4) 


(2.5) 


0  -  e  =  t- 


+  Q,(9)  +  Qo( 6)  +  o  (n-3/2) 


(2.6) 


3.  LACK  OF  THIRD  ORDER  EFFICIENCY  IN  THE  SENSE  OF  RAO 


Define 


T'  =  9  +  6*{X3  -  ir3(0)}' 


where 


tt3( 0)  -E Q(X3) 


and  6*  is  a  constant  to  be  suitably  chosen.  Then  like  0,  T'  is 
Fisher  consistent.  Let 

VW0)>3  =  £(  e )  /n2  +  o(n~2) . 

-2 

Then  T'  adjusted  to  have  same  bias  as  the  mle  (up  to  o(n  ))  is 
T  *  0  +  **C{X3  -  r3(0)}3  -  C(T')/n2]  . 


We  shall  show 


W®-6>2  >  WT-9)2 


(3.1) 
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_  3 

if  we  neglect  terms  of  order  o(n  ).  Of  course  a  similar  inequality 
A  2  2 

Ee=_o(9’~$)  >  ^^(T'-Q)  holds  if  instead  of  adjusting  Tf  we 

A  -2 
adjust  0  to  fl'  to  ensure  same  bias  as  T'  up  to  o(n  ).  We  shall 

refer  to  (3.1)  as  lack  of  third  order  efficiency  in  the  sense 

of  Hao. 

For  6  =  0, 


Z 


n 


W 


n 


=  0, 


U*  =  -12(2A2+4AB+B2)/(A+B)2 


(3.2) 


1(0)  = ( 3A+B) / ( A+B) , 

tt3(0)*0,  ^3(0 )  =  0  ,  Ee=0(X2)=0. 


To  calculate  5(9),  we  use 

{X3-7T3(9)}3  =  C  {  X3-7T3(  6  )  }3  -  3(X-1T3(e))2(0-0)  TTgCe) 

+  3(  X3-tt3(  e  ) )  (0-0)2(tt^(0)  )2  -  (0-0)3(-r^(0))3]  +  smaller  terms 
which,  using  (3.2),  gives  for  9  =  0 

{X3-i.3(6)}3  -  X3+op(n-2) 

and  so  £(o)  =  0. 

Observe 

E0sO(T-0)2  =E0=o(0-0)2  +  6*2E0=o[{X3-u3(0)}3  -  C(T' )/n2]2 

+  26*  E0=o(  0-0)  {  (X3-tt3(  9  )  )3  -  S(T*  )/n2} 

(3.3) 


We  first  note  that  the  second  term  on  the  RHS  of  (3. 
(3.2)) 


E9-0<X3>  + 

15  <•  A+3B; 3  .  -3  N 

=  “3  {"ATB}  +  o(n  >  * 


For  the  third  term  on  the  RHS  of  (3.3),  we  have, 


E0=O(e'e){(X3“Tr3(e))3  ~  5(T')/n2} 

z 

-  Ee=0(ITfT+«2+«3)(Ci3-»3<e))3-S^}+o<n-3,  by 
=  Ee=o(Q2+Q3){(X3-TT3(0))3  -  5(T’)/n2}  +o(n-3) 


(since  EaZ  { . 
y  n 


z  w 

_  v  f_n _ n-  .  _n _ n 

e*°i2(e>  7VT 


■>  V 

Z  IV2  U*(0)z3 


)  = o(n  3) ) , 


6I4( 0) 


— ) ( X3 )  +  o(n~3) 


_  -  ,2XA  ,  4*A  ,  “X  „3  .  -3 , 

~  _ /-v  i  o  o  t  o(  n  ) 

r  ■*  /  f\  \  O 


'0=O  I2(0) 


I3(0) 


61  (0) 


We  observe,  after  some  straightforward  calculations, 


eq_0  XxX2  X3  =  o(n  3) 


E6=0X?X3  * 
E6=0*1^2*3  “ 


6C  ,  ,3. 

•  — +  o(  n  ) 

n3 


is  (using 


(3.4) 


(2.6) 


(3.5) 


(3.6) 


A+3B 

(A+B)2 
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Using  (3.4),  (3.5)  and  (3.6)  we  get  from  (3.3), 


„  ns2  r,  ,2  n  s2  ,  f  r*2n  e/A+3B,3  .  46*  A+3B  1  ,  ,  -3N 

Ea-n^7-0)  =  Efi_n(  6-6 )  +16*  15(— rro)  +-s - s- •  6C1  -o+o(n  ) 

0-0  0-0  A+B  i2(Q)  (A+B)2  n 


Recall  that  1(0)  = ( 3A+B) /(A+B)  so  that  the  coefficient  of  n 
above  is 


-3 


156*2(^||)3  +  46*  (-A-+3_B)  6C 
A+o  , o  i %  . ■,  6 


( 3A+B) 


which  can  be  made  <  0  if,  say, 


A  =  B  =  1 ,  6*  <  0  and  206+C  >  0. 


This  proves  (3.1). 


4.  LACK  OF  THIRD  ORDER  EFFICIENCY  IN  THE  SENSE  OF  FISH ER-RAO 

A 

The  third  order  loss  of  information  for  9  may  be  defined 
as  follows.  Let 

V9  =  —  A^-L-  -  a  /n  -  3n(  9-6 )  -  Yn(0-0)2  -  6n(0-0)3  . 
n  q.  0 

A  -1 
Let  £2(6,6)  be  the  variance  of  above  expanded  up  to  o(n  )  and 

then  minimized  with  respect  to  the  coefficients  3,y,6.  Of  course 

at  does  not  play  any  role  in  this.  The  values  of  8,y,6  obtained 

in  this  way  will  depend  on  n  and  will  be  denoted  as  8n  etc. 

Similarly  we  define 

VT( 0 )  *  -  at  Vn  -  B'n(T-e)  -  y’d(T-0)2  -  6'n(T-6)3 

n  ciu 

and  then  EgtT,©)  as  above.  We  shall  show 


t 


8 


E3(e,  0)  >  E3(T,Q)  for  6  =  0 


(4.1) 


We  sketch  a  proof. 

Using  (2.6)  and  (3.1)  one  can  show  that  for  the  present  pur¬ 
pose  of  evaluating  up  to  o(n  ^),  we  may  take 


3. 

"n 


I<0)+7E  + 


n 


Yn  =  Yo+?E  + 


d 


n 


o 

o 


+ 


v'n 


(4.2) 


(where  yo  is  in  fact  the  coefficient  A  arising  from  considerations 
of  second  order  efficiency,  vide  Ghosh  and  Subramanyam  (1974)). 

The  following  facts  will  be  needed  : 


Covg*o^l^2  ’*3^  56  °^n  ^ 

Cove=0^1^2  * ^3 ^  ^  E0=O^1^2^3“‘  *  Cov9  =  0^1^2  ’^1^3^  “  °^n  ^ 

'“W*?-*!3  *  Ee-ocx?x3}  *  cove.ociti  -*i*i3  - 

C°W*?'i!33*W*?X33'CoV0tiil’XlX33'O<“'3)  <4'3) 

Cove_0[X1  Xg , S3 ]  -  o(n"3) 

cove=(,[!!3,X3:.o(„-3) 

CoW*2’X33"°(n'3) 

“W*!-*!3  *  0 


Now  at  9  =  0  (with  A  =  B  =  1  and  hence  1  =  2) 
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X  2X  X  4X  I*  U*X3 

e  -  e  =  — i  +  ( — V^)  +  (-  4--  +  -2-j). 

1  I  I  61 


Hence 


Vn  (e=0)»-i/n-  {/n  +  2n  -y—  +  — 

V  V  V  V  V2  ^3  ~2  y2y  y3 

X,  X,  X~  X-.  X~  *X,  X^  A,  X~  A, 

-•.  30  —  +  2»'n  3,  +  4n  +  n  U  +  /nv,-4  +  4nv  +  nd  Hr! 

21  1  ,2  i2  n0I3  lx2  o  j3  o  j3 

x.x_  4X, x?  u*X?  v0x?  3L5L  x2x2 

-•2c  >  n6 i(-Tr  +  -V)  + -^  +  4/E  y  +  4nv 

2  l  1  l  6i4  r  1  r  °  i4 

x  4x  xf  u  x:r  _  x:r  x:rx 

+  2ir.  ■=— •  ( - tA  +  — S— 4)  +  /n  5,  — ~  +  6n  5  — ^— }  +  smaller  terms 

°  1  I3  6I4  1  I3  °  I3  (4.4) 


VT(6=0)  =  V9(0=O)  -  6*{nl  X?>  +  smaller  terms 
n  nv  3 


(4.5) 


Using  (4.3),  (4.4)  and  (4.5)  we  can  prove 
VarJ=o(V^(0=O)  =E3(3,6  =  0)  +  [Vare=0(nl  o*  X3)+  45*n2Cove=0(X]X2  ,X 


=  E„(9  ,9  =  0)  +  I2  — (6*)2  +  —  -C  +  o(n  L)  (4.6) 
j  n  n 

The  sum  of  the  last  two  terms  on  the  RHS  of  (4.6)  can  be  made  <  0 
by  taking  <5*  <  0,  206*  +  C  >  0.  Now  (4.1)  follows  from  (4.6). 


5.  CONCLUDING  REMARKS 

A  close  inspection  of  the  proof  will  reveal  that  the  reason 
for  lack  of  third  order  efficiency  is  due  to  the  non-zero  co- 

A 

variance  between  (Q2+Q3)  and  (T-0).  This  covariance  is  likely 


CO  CO 


to  be  non-zero  in  most  cases  but  except  in  specially  constructed 
simple  examples  like  the  present  one  checking  this  would  involve 
prohibitive  calculations . 

It  would  be  interesting  to  show  that  not  only  the  mle  but 
no  other  estimate  can  possess  third  order  efficiency. 
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